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Abstract 


Local bandwidth has been estimated for the non-stationary signals. For estimating the 
local bandwidth the real time data (signal) has been approximated using orthogonal 
polynomial series. Assumption has been made that in the bounded region the highest 
frequency will dominate in the higher order derivatives (say higher than sixth order 
derivative). Derivatives have been estimated using orthogonal polynomial approxima- 
tion. Before testing the efficacy of this method on real time signals, it has been tested 
on sine-waves and mixture of sine-waves of different sets of frequencies. This method 
of estimation of local bandwidth has been applied to real time non-stationary signals 
of EGG and EEG. The results have also been cross- verified by auto-regressive method 
of frequency estimation. 
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Chapter 1 


Introduction 


To find the local bandwidth implies, finding the highest frequency present in a small 
span of the signal. This frequency represents the local bandwidth or the highest fre- 
quency component associated with the local region of the signal [1]. 

1.1 Motivation for the Thesis 

Finding the local bandwidth is an important part of tlie signal analysis. To estimate 
the local bandwidth reasonably accurately and quickly has a number of uses. One of 
the numerous uses that comes to mind is in non-uniforrn sampling, which in turn founds 
applications in such diverse fields as machine vision, radio astronomy and computed 
tomography. In non-uniform sampling finding the local bandwidth enable us to change 
the sampling interval accordingly. Reconstruction of the signal from non-uniform sam- 
ples, taken at a frequency of twice the local bandwidth, is possible was shown by Clark 
and Palmer [1]. This conclusion has been reached from a different direction by Hori- 
uchi [2]. The conventional methods for calculating the local bandwidth are Short Time 
Fourier Transform (STFT), Auto- Regressive Frequency Estimation (ARFE) and Maxi- 
mum Like-liliood Estimation of Frequency (MLE). Though there are a number of other 
ways to do the frequency analysis also, but most of them arc q\iite computationally 
intensive. Thus to find an efficient way for finding the local bandwidth is important. 
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1.2 Work Done in this Area 

Initially the previous work of reference [3] was tried to be extended. In estimating the 
local bandwidth, for calculating the higher order derivatives use of the divided difference 
table had been made in the previous work. This divided difference approach is relatively 
a quite simplistic one. A more exhaustive approach to find the higher order derivative 
was tried in the present work. The function represented in the sampled data was 
approximated by a polynomial of suitable order. This method had its own limitations, 
if the frociuencics jircsent in the signal were closer together, it required higher order 
(hnivative to be evaluated thereby requiring higher order polynomial to be litted, which 
became computationally intensive and also did not provide quite satisfactory results 
due to inherent problem of error propagation in the divided difference table. 

1.3 Objective 

In the present work an attempt has been made to estimate the local bandwidth of 
the signals using orthogonal polynomials. A much better way to find the higher order 
derivatives was to use orthogonal polynomial approximation. In which higher order 
derivatives can be evaluated by using simple recurrence relations and also the polyno- 
mial approximation using minimum error variance criterion has inherent noise rejection 
capabilities. To sec the fetisibility of using the orthogonal polynomial to find the higher 
order derivatives and thereby finding the local bandwidth, it was first used to find the 
frequency of a single sine wave. Then the maximum frequency for a signal which con- 
tained a mixture of sine- waves was taken. Later, this method was tested on real time 
EGG and EEG signals. 

1.4 Organisation of Thesis 

This thesis work has been organised into five chapters. Ghapter 1 deals with the 
introduction. Ghapter 2 gives basics of orthogonal polynomial approximation which 
constitutes an important part of this thesis for estimating the frequency. Ghapter 3 
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describes the basic principle of estimating the frequency. Its salient features, limitations 
and constraints has also been discussed in this chapter. Its application to the real time 
ECG and EEG signal has also been dealt with in this very chapter. Chapter 4 gives the 
results and analysis. Chapter 5 concludes the thesis work with suggestions for future 
work. 

Appendix A gives the algorithm for the generation of orthogonal polynomials and 


their derivatives. 



Chapter 2 


Orthogonal Polynomial Approximation 


Tlie problein of approximating a function whose values at a sequence of points are 
generally known only empirically, and thus are subject to inherent errors which may 
be large, is a serious one. The Orthogonal polynomial approximation (using least 
square approximation) is a technique by which noisy functional values may be used 
to generate a smooth approximation to the function. This smooth approximation can 
then be used to approximate the derivative of the function more accurately than exact 
approximations [5]. The procedure to generate the rcccurcncc relations of the func- 
tional approximation and its derivative approximation through orthogonal polynomial 
approximation has been given in the next section. 


2.1 Reccurence Relations for Generating Orth. Poly. 

If the abscissas of a function given at m discrete points be (xi, fi) then it can be 
approximated by use of a scries of orthogonal polynomials Pj{x) . 

Suppose the set {pj{x)} is any sequence of polynomials satisfying the orthogonality 
r(!latioiiship ( 2.1) with respect to the sc(iuenco of data points {xf} i.e.. 


^Pj{^i)Pk{Xi) = < 


t=i 


1 

0 


j = k 
j 7^ k, 


( 2 . 1 ) 


□Then the polynomials are evaluated by the recurrence relation [6] 


Pj+i(x) = (x - aj+i)pj(x) - 6jPi_i(x) 


i >0, 


( 2 . 2 ) 
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with Po{^) = 1, = 0 

and aj+i and bj are constants given by 
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- Wi 



Wj-i 


(2-3) 

where Nj is the scalar product of the orthogonal functions. 

The generating polynomials for the first and the rith order derivatives can be eval- 
uated in a similar way by differentiating the equation (2.2) required number of times, 
i.e., 

p]+i(^) = Pji^) + (^ - ai+i)pj(a:) - j > 1, (2.4) 

with pI(x) = 0, Pi (a:) = 1. 

} 

p^^j(x)=np'Ti(rr) + (rr-aj+i)p^(a;)-6jP^_i(a:), n>2,j>l, (2.5) 

with pI){x) = 0, p”(,'/;) = 0 


where aj 4 .i and bj are defined as in equation ( 2.3). 

Then the function given by m points {xi,fi) can be approximated by the least- 
squares approximation (orthogonal polynomial approximation) 

71 

yn{x) = n<m-l, (2.6) 

j=o 

and the first and second order derivatives are approximated by 

PrU^O = H Ap](^') n<in, (2.7) 

j=i 

and 

3=2 


n < 7/1, 


( 2 . 8 ) 
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where, 

m 

Aj = 0 < i < m 

The representing polynomial series should be truncated at the polynomial degree 
of approximation where the error variance given by 

" m-n- 1 ^ ^ 

is either minimum or does not decrease appreciably any further with increase of poly- 
nomial degree. It is count(ir-pro(luctive to include more terms because the redundant 
ones describe the noise in Ji. 

Refer appendix A for the algorithm of generation of orthogonal polynomials and 
their derivatives. 

2.2 Graphs 


Figure 2.1 shows the graph for orthogonal polynomials of degree j = 0, 5. First 

and second derivatives of the orthogonal polynomials of degree j = 0, 5 have 


l;cen given in Figure 2.2 and Figure 2.3 respectively. Similarly graphs for the orthogonal 
polynomials of degree j — 9, 10, 11 and the corresponding sixth order derivatives have 
been shown in the Figure 2.4 and Figure 2.5 respectively. 

2.3 Advantages of Orthogonal Polynomial Approximation 

Some of the distinct advantages of orthogonal polynomial approximation are given 
below [5], [8]: 

• The orthogonal polynomial approximation uses the least-squares criterion. By 
this, the approximated function is not only accurate at data points, but also at 
other values in a given interval. 
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• It provides ix couvciiiciit method of approximating a function since it can be easily 
implemented on a computer. 

• In this technique the ininimuin error-variance criterion is used to get the polyno- 
mial degree of the approximation. This feature ensures maximum noise rejection 
at the sampled set of data points. 

• The differentiation of the polynomial approximation can be easily mechanized on 
a computer. 

• The numerical stability for the orthogonal polynomials is quite good. 

• The math analysis required for the orthogonal polynomials is easy though the 
evaluation count required is a little bit high. 















Figure 2.4: 





Chapter 3 


Theory and Implementation 

3.1 Basic Principle for Local Bandwidth Estimation 

Coiisidor a signal consisting of a mixture of various sinusoids: 

<j{t) = a!i sincuif- + 0:2 sina; 2 i 4- ois sinoiat (3-1) 

where ai, oi 2 , 0:3 are the amplitudes associated with the sinusoids and aj(= 27r/) is 
the angular frequency and / is the frequency of the sinsoid. Here the assumption has 
been made that > wa > W 3 and the difference in frequencies is such that if we take 
the higher order derivative then the effect of the lower frequency can be neglected i.e., 

= —ujfasinufit — w^/^sinw-i^ — a; 37 sina; 3 t (3.2) 

can be approximated as 

y®(f) = — wjasinwii (3.3) 

i.e., oji is sufficiently larger than a;® and wj’. 

Similarly the eighth order derivative of the function g(t) can be approximated as 

g^(t) = (iff a sin cxJit (3.4) 

ft i.s assumed that the signal /;(/,) is bandlimited. 

From equation 3.3 and equation 3.4 we get, 
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this implies that, 


Ul 


1 


aHt) 


(3.5) 


/l = 


_ -fit) 

27r\| 5®(t) 


(3.6) 


we can calculate the highest frequency fi i.e., the local bandwidth. In this way by 
calculating the higher order derivative we are able to get the local bandwidth of the 
signal. 


3.1.1 Limitations 

• If the frequencies present in the signal are not very much far apart, then to 
distinguish the highest frequency a much higher derivative may be required to be 
calculated, and we know that calculating derivatives has inherent errors. 

• If two close frequencies are present in the signal then the higher order derivative 
may simply not be approximated by equation 3.2. 


3.2 Theory 

In the previous work [3] the derivatives over 10 sample points were calculated by 

^ = i.) (3.7) 

where /[ti,t 2 , tn] represents the divided difference. Taking derivative in 

this manner is a rather simplistic approach. But here in this thesis a more elaborate 
and accurate way to find out the derivatives was tried. A ninth degree polynomial was 
fitted in the 10 points [9]. 


(1] t + ( 7 ,() = () 


(3.8) 
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Then the ninth order derivative will be given by 

(j^ n 

= 362880% (3.9) 

and the seventh order derivative at any point t will be given by 

cJJ 0 

= 181440a9i^ + 40320a8t + 5040a7 (3.10) 

Software was written to calculate various order derivatives and to estimate the 
maximum frequency i.e., the local bandwidth from 10 sampled points. Derivatives 
were also tried to be found by the differentiation formulae given by W. G. Bickley in 
a ta!)ular form [7j. 


1 

'rr^y^ ^ ^(^o2/o + -^22/2 + + ^eye) (3-11) 

where stand for the value of {d^yfdx'^)r, i.e., for the mth differential of y at the 

point x/l = r/n. Then, h denoting the quantity l/n, The values of Aq, Ai Aq (for 

n = 6) in equation 3.11, for m = 1, 2, 6 and for r = 0, 1, 2, 6, are given in 

tabular form. 

But the results were not very satisfactory and also these methods had some lim- 
itations. If higher order derivative than sixth order was rcq\iircd to distinguish the 
highest frequency then the sampled points required will increase requiring a higher 
order polynomial to be fitted. It became very computationaly intensive as well as the 
approximation of the derivative was not very accurate. 

This resulted in looking for a better and easier way to represent the higher order 
derivatives. The answer was found in the orthogonal polynomial approximation. 

The orthogonal polynomial approximation with minimum error variance provides a 
suitable representation when not only the function values, but also the derivative values 
are to be computed. With orthogonal polynomial approximation, the higher order 
derivatives can easily be approximated in terms of the derived orthogonal polynomials 
which are derived by the use of simple recurrence relations. When finding the local 
bandwidth by finding the higher order derivative thro\igh orthogonal polynomials some 
important things should be observed as explained below [4]. 
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3.2.1 Important Parameters for Orthogonal Polynomial Approximation 

Choice of Span 

When the signal consists of fast variations alongwith the presence of very slow variations 
as is the case with the EGG signal. In such cases choosing the number of sample points 
in the span becomes an important parameter in estimating the local bandwidth of the 
signal. For a quickly changing signal if we take a large span (i.e., more number of 
sample points) then the fast variations in the signal will be averaged out and we would 
not get a correct estimate of the highest frequency present in the local region. Whereas 
if the span is small in case of the slowly varying signal thou again the estimate would 
not be accurate. When the noise is present alongwith the signal, in such cases it is 
better to take a larger span of the signal to estimate the frequency. Then that span is 
approximated by a lower order of approximation (i.e., averaging out the noise) thereby 
giving the correct estimate of the local bandwidth. An indication towards the frequency 
contents can be got from the coefficients of the polynomial and the error variances. The 
use of this tecnique has been made in the case of EGG signal which has both very slow 
and very fast changes in the signal. 

When the fast signal variations arc encountered in the EGG signal, the first error 
variance component becomes very high, and based on this fact the single span i.e., 
number of sampled points chosen to estimate the frequency is made equal to 22 sample 
points. When the slow variations are present in. the signal, the span is chosen as 72. 
In this way we are able to get quite accurate estimates of frequencies even for a signal 
which has wide range of sudden variations in the frequencies. 

Choice of Order 

Ghoosing the order of approximation is an important factor in getting good results. 
Experimentation on a large number of signals give an idea on how to choose the order 
of approximation. Basically the thumb rule can be established as: 

In the pnisence of noise mixed with the sainphid signal values, the series 
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/W = i;c,Pi-,(t) (3.12) 

i=i 

where is a polynomial of degree (j - 1), and cj is its coefficient, should be 

truncated at the order of approximation where the error variance 


cr7 = 


ElfM-iciPj-iMP 

k=l j=l 

K-J 


where J < N < K, 


(3.13) 


is either minimum or <loes not decrefuse appieeiahly any further with the increase 
of approximation order. 

The error-variance vs order plot for two cases (one on 22 points data taken from 
ECG samples and the other for 35 points data taken from EEG signal) have been 
shown in Figure 3.2 and Figure 3.1 . Figure 3.2 shows a simple case in which the order 
of approximation has been chosen as 10, as is expected. But whereas Figure 3.1 gives a 
typical case. The order of approximation for this case has been chosen as 6 whereas it 
could very well have been taken as 26. But that would have given us a wrong estimate 
as it would be approximating quite a lot of noise in that case. 

Limitations [4] 


• Since the polynomials are computed by recurrence relation, the quantization error 
introduced in the higher order polynomials can be a problem when a large number 
of data points are processed and (or) the additive noise is not purely white. It 
is then advisable to restrict the value of N i.e., the span and number of sampled 
data points, so that the region of oscillation in the error variance plot, as shown 
in the Figure 3.1 can be avoided. 

• When noise is present, the errors of approximation in the derivatives may become 
large at the ends of the sampling span. Hence the result can be expected to be 
in error at the ends of the span as shown in the Figure 3.3 which shows the sine 
wave and the approximation of sinc-wavo, 4ih and 8{/i order derivatives. 
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3.3 Application 

3.3.1 Testing on Stationary Signals 

To test the accuracy of the proposed method, initially, it was tested to determine the 
frequency from the data generated by a single sine wave of the form 


^i[n] = 1.0sin(a;cnT) 

(3.14) 

where the continous frequency 


f 

27r 

then the Nyquist frequency 


fnr — ^fc 

(3.15) 

and the sampling frequency is chosen to be 


fs = vfnr 

(3.16) 

1 ] is chosen to be 4. Sampling time interval 


r = — = — 

fs dwc 

for this case the discrete frequency 

(3.17) 

h = hT<\ 

(3.18) 

i 

40 

(3.19) 

say if Wc = 5 then T = ^ and fd = 0.125. 



After this two different sine waves were superimposed together and the same was 
also tried wi1,h the sine waves of three dilfcrcnt freciiKiucics. A lot many such sots and 
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combinations were tried. The data generated in the case of three frequencies was from 
the signal 7 /( 72 ], where 


y[r 2 ] = 51(72] +g 2 [n] + ^3(^1] 


(3.20) 


where, 


5i(n] = 1.0sin(a;i72] 


52 [^*] = 1.0sin(uj2^i 


53(72] = 1 . 0 sin(a; 372 ] 

where wi, W 2 and W 3 are three different signal angular frequencies and /i, /2 and fz 
are the corresponding signal frequencies. 

3.3.2 Testing on Non-StatiOnary Signals 

After testing the procedure on these simple cases, real time non-stationary ECG and 
EEG signals were attempted. 

ECG signal is a difficult signal to analyse as it contains very slow variations along- 
with suddenly arising fast variations. But this difficulty was overcome by changing the 
span (the number of samples) accordingly, as has already been discussed. 

EEG is a highly non-stationary signal. EEG is the electrical activity of the brain, 
monitored by scalp electrodes. The EEG signal level is typically 10 to 200 microvolts 
and occupies a frequency range from near DC to approximately 30 Hz. The classifictv- 
tion of EEG is based upon its frequency contents. There are four fundamental rythms 
seen in an adult human brain ( 10 ], ( 11 ]. 

1 ) Alpha Rythm. The usual range of alpha rythm frequency is from 8 to 13 Hz. 
The normal amplitude of alpha rythm tends to be between 10 to 150 microvolts. Alpha 
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rythni occtirs during relaxed wakefulness when there is little information input to the 
eyes, jjartieularly when they are closed. 

2) Beta Rythm. This rythm luis a frequency range of 12 Hz and above. These 
have the voltages of the order of 10 microvolts and below. 

3) Theta Rythna. This rythm luxs a frequency range of 4 to 7 Hz. 

4) Delta Rythm. This rythm has a frequency range of less than 4 Hz. These are 
waves of large amplitude, often over 100 microvolts. 

The signal data on which the frequency estimation was carried out was of Beta 
rythm typo. It was taken from EEG done on a male of 25 years of age. 



ORDER 


Figtire 3.1: Error Variance Plot for EEG Signal (35 points). 
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ORDER 


Figure 3.2; Error Variance Plot for EGG Signal (22 points). 




Figure 3.3: (a) Sinc-wavc. (b) Approximation of Sine-wave, (c) Approximation of 
4y, order derivative and (d) Approximation of Sm order derivative through orthogonal 
polynomials. 






Chapter 4 


Results and Analysis 


Tho frequency has been estimated for single sine wave and mixture of several number 
of sine waves. Figure 4.1 shows the frequency estimate for the case where angular 
frequency oji = 10. A thirty point span is considered to estimate the frequency of the 
signal. Figure 4.2 shows the frequency estimate for the case where angular frequencies 
wi = 8, and W 2 = 3. A thirty point span has been considered to estimate the frequency. 
Figure 4.3 shows the frequency estimate for the superposition of three sine waves with 
tho angtilar frecjucncies as a»i = GjWa = 3 and wa = 2 . A twenty point span has been 
considered to estimate the frequency. The results are in error at the ends of the span 
as explained in chapter 3. 

4.1 Simulation Results for ECG Signal 

Typical ECG signal taken for the frequency estimation is shown in the Figure 4,4. Its 
frecpiency estimate with respect to the time axis is shown in the Figure 4.5 . Alongwith 
these results the frequency estimates got for the same data from auto-regressive method 
Inis also been given. Time span i.c., the number of sample points for these has been 
chosen as 40 sample points. 
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4.2 Simulation Results for EEG Signal 

Typical EEG signal of a 25 year jnalc taken for the frecjiicncy estimation is shown 
in Figure 4.C. It has continuously changing frequencies and is highly non-stationary 
in nature. Its frequency estimate with respect to time axis is shown in Figure 4.7. 
Alongwith tliose rosiilts the frequency estimates got for the same data from Auto- 
Regressive method has also been given. 



10.00 12.00 14.00 16.00 18.00 20.C 

TIME 


Figure 4.1: Sine Wave with angular frequency tU] = 10. 










AMPLITUDE 



















Ci lap ter 5 


Conclusions 


'I’lic i('.sult..s for ICCG aiui EEC! signals havS also been verified by using auto-regressive 
met liod and the estimation through orthogonal polynomial approximation. Both the 
results nmteh (juite closely ;vs shown in chapter 4. Though more accurate, the auto- 
regr<'.ssive method is mneh more computationally intensive as compared to the estima- 
I ion of local bandwidth using orthogonal polynomial appi'oximation. The estimation of 
local bandwidth through the use of orthogonal polynomial approximation is quite easy 
in its concept and is very efisy to implement. It is also not computationally intensive. 
Ho it has many uses and can be used for the on-line applications. 


5.1 Future Work 

Fimling the order of approximation is relatively a complexer job, as has been discussed 
in chapter 3. A more comprehensive and elaborate algorithm can be developed to 
('.stiniato tin* onler of approximation by studying a number of different signals. 

This method of local bandwidth estimation can be applied to get the non-uniform 
sami)ling and the advantage; gained thcreljy can be studied. 

The hardware implementation of this method can be carried out and can be used in 
non-uniform sampling scheme to change the sampling interval. 



Appendix A 


Algorithm to Obtain Orthogonal Polynomial 
Approximation and its Derivatives 


Thf alf'oritlun to g<;t tho Orthogonal Polynomial Approximation is obtained by 
\ising ('qimthms ( 2.2), ( 2.3),{ 2.6), (2. 4) and ( 2.5). 

♦ Input data 

n 


• Algorithm 

for i = 1, .. .,m 
do 


p-i{xi) <-0 


Po{Xi) 4 - 1 
plixi) 4- 0 
p\{Xi) 4 - 1 
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Poi^i) 0 


n>2 


PU^i) ^ 0 


n>2 


Vni^i) i — 0 


cncifor 


Nq i—m 


bo ■< — 0 

for ;• = 0, 1, . . . , n 
(Jo 

m 

^ YJiPii^i) 

t=l 


for i = 1, . . . , rn 
do 

Vni^i) ^ yn{Xi) + AjPj(xi) 

Vni^i) ^ Vni^i) + Ajp'}{xi) 


endfor 

if j — n then stop 


%+i ^ 




Nj 
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for i — 1 , . . . , m 
do 

^ (2:i — afj^i)pj(xi) — bjPj—i(xi) 

Pj+i(x) np’j^-' + (.Xi - aj+i)p'^(xi) - bjp^_i(xi) 
endfor 




i=I 


onclfor 




N, 


• Output 


j j — 0, . . . , Tl 
ajJ = l,.,.,n 
f>j,j = 1) 

yn{^i),i = 1,. ..,m 

yni^i)^i = h---,rn 

m To find the minimum error-variance, equation ( 2.9) is used. The algorithm for 
finding the minimum error-variance is: 

for A = 0, . . . , n 

do _ 

2'. 


endfor 
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Clu)t)S(' fc for \vhich al is minimum. For this value of k compute yn{^i))i = 1, . . . , m. 
This gives the least squares approximation of at data points {ccj}, i = 1, . . . , m. 

Though in practice the algorithm for finding the order of approximation is not as 
simple as tins, as is shown in chapter 3. More complex logic has been implemented to 
suit the partieular case. 
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